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JOINT  PROBABILITY  DENSITY  FUNCTION  OF  SELECTED  ORDER 
STATISTICS  AND  THE  SUM  OF  THE  REMAINING  RANDOM  VARIABLES 

INTRODUCTION 

Detection  and  location  of  weak  signals  in  random  noise  is 
frequently  accomplished  by  the  ordering  of  the  random  variables 
(RVs)  in  a  measured  data  set,  followed  by  an  investigation  of  the 
locations  and  statistics  of  several  of  the  largest  RVs  under 
consideration.  Also  of  interest  are  the  remaining  smaller  RVs  in 
the  data  set,  which  can  be  used  to  estimate  the  background  noise 
level  and  to  form  a  basis  for  normalization,  thereby  realizing  a 
constant  false  alarm  processor. 

In  this  study,  the  original  data  set  {x^}  is  composed  of  N 
independent,  identically  distributed  (IID)  RVs  with  a  common 
arbitrary  probability  density  function  (PDF)  p(x).  This  data  set 
is  ordered  into  the  modified  data  set  n=l:N,  of  dependent 

RVs,  where  x'  >  x'  >  • • •  >  x^.  Then,  M-1  RVs  are  selected  from 
this  latter  data  set,  namely,  the  n^-th  largest  RV,  the  n2-th 
largest  RV,  ...,  and  the  njj_^-th  largest  RV  (M  >  2),  where, 
without  loss  of  generality,  1  <  n,  <  n_  <  •••  <  n„  .  <  N. 

Finally,  the  sum  of  the  remaining  RVs  in  the  ordered  data  set  is 
formed  for  a  total  of  M  dependent  RVs.  The  joint  M-th  order  PDF 
of  these  M  dependent  RVs  is  the  quantity  of  interest. 
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For  convenience  of  notation,  the  M-dimensional  random  vector 


(RV)  z  =  [z^  •••  Zj^]  is  defined  as 


z 


1 


z 


M-1 


(1) 


where  the  tic  mark  on  the  sum  denotes  n  /  n^,  1X2, 

Thus,  the  first  M-1  components  of  RV  z  satisfy  the  inequalities 
^  *2  -  -  *M-1*  joint  PDF  of  M-dimensional  RV  z  is  of 

interest  here. 


To  determine  this  joint  PDF  of  RV  z,  a  series  of  simpler 
problems  will  be  solved  first,  and  the  results  will  be 
interpreted  in  terms  of  conditional  PDFs.  From  these  simpler 
results,  the  general  form  of  the  M-dimensional  joint  PDF  of  RV  z 
in  equation  (1)  can  be  deduced.  The  end  result  is  a  single 
one-dimensional  contour  integral  for  the  joint  PDF  of  z,  which 
can  easily  and  accurately  be  numerically  evaluated  by  moving  the 
contour  of  integration  to  pass  through  the  saddlepoint  of  the 
integrand.  As  a  backup,  an  alternative  approach  involving  the 
joint  M-dimensional  moment-generating  function  (MGF)  of  RV  z  will 
also  be  derived;  however,  it  is  not  as  useful  as  the  single 
contour  integral  indicated  above. 

Since  the  original  RVs  are  IID  with  common  PDF  p(x),  the 

N-dimensional  joint  PDF  of  the  ordered  RVs  n=l:N,  is  simply 

g(Uj^ ,  .  .  .  ,u^)  =  N!  p(u^)  •••  P(Uj^)  for  u^^  >  U2  >  •••  >  u^^  (2) 
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for  n=l:N-l 


and  zero  elsewhere.  The  requirement  that  u  >  u  . 

n  n+l 

represents  the  statistical  dependence  amongst  the  ordered  RVs . 

For  later  use,  it  is  convenient  to  define  two  auxiliary 
functions.  First,  using  the  common  PDF  p(x)  of  RV  x^^,  function 

u 

c(u,X)  =  J  dx  p(x)  exp(Xx)  (3) 

~eo 

is  defined,  which  is  a  mixture  of  a  cumulative  distribution 
function  (CDF)  and  an  MGF.  That  is,  c(u,0)  is  the  first-order 
(FO)  CDF  of  RV  x^,  while  c(+®,X)  is  the  FO  MGF  /j{\)  of  RV  x^, 
n=l;N.  Variable  u  is  real,  while  X  can  be  complex. 

Also  defined  is  the  auxiliary  function 
+  00 

e(u,X)  =  J  dx  p(x)  exp(Xx)  ,  (4) 

u 

which  is  a  mixture  of  an  exceedance  distribution  function  (EDF) 
and  an  MGF.  That  is,  e(u,0)  is  the  FO  EDF  of  RV  x  ,  and  e(-®,X) 
is  the  FO  MGF  fj{\)  of  RV  x^,  n=l:N.  The  two  auxiliary  functions 
are  interrelated  according  to 

c(u,X)  =  e(-®,X)  -  e(u,X)  =  //(X)  -  e(u,X)  ,  (5) 

e(u,X)  =  c(+®,X)  -  c(u,X)  =  fj{X)  -  c(u,X)  ,  (6) 

where  fj(\)  is  the  common  MGF  corresponding  to  PDF  p(x).  Several 
useful  examples  of  the  c(u,X)  and  e(u,X)  functions  are  listed  in 
appendix  A. 
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SOME  SPECIAL  CASES 


JOINT  PDF  OF  THE  LARGEST  RV  AND  SUM  OF  REMAINING  RVs 


For  this  special  case,  M  =  2.  The  second-order  (SO)  MGF  of 
RV  z  =  [z^  Z2I  given  by  the  expectation 

ri^2 


r  ^  'i 

=  E  exp(Xj^Zj^+X2Z2)  =  E  exp|^Xj^x'  +  X2  YU  *nj 


.  J...J  du^ 


r  ^  '» 

9<«1 . “h>  ’'2  C  “nj 

n=z 


u. 


=  N!  J  du^  p(Uj^)  exp(Xj^Uj^)  J  du2  P(u2)  exp(X2U2) 


u 


N-1 


X  J  du^  exp(X2Uj^)  . 


(7) 


Denote  the  integral  on  variable  by  Then,  by  reference  to 

equation  (3), 


^^^N-1'^2^  ■ 


(8) 


Next,  there  follows 


u 


N-2 


'n-1  -  J  ''“n-1  p‘“n-i>  “n-i>  “<“n-1’''2> 


u 


N-2 


=  J  ‘^'^N-l  ^'<'^N-1'^2)  c(^N-1'^2)  “  I  ['^(’^N-2'^2)]  • 
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Continuing  in  this  manner  leads  to 


^N-2  "  3!  "  *  *  ' 


^2  “  (N-1)  ! 


N-1 


(10) 


(11) 


or,  generally,  to 


N+l-n 


^n  “(N+1 


T^HTT  [‘^<%-1'^2M  "=2:n 


(12: 


Finally,  the  SO  MGF  of  RV  z  is 


=  N  J  du^  p(Uj^)  exp(X^  u^)  j^c(Uj^,X2) 


N-1 


(13) 


This  single  integral  must  be  numerically  evaluated  to  determine 
the  SO  MGF  /t/^(  Xj^,X2)  . 


For  PDF  q(u)  =  5(u  -  a),  the  MGF  is  exp(X  a),  and  the  inverse 
Laplace  transform  is  given  by  the  Bromwich  contour  integral  on  C: 


q(u)  =  J  dX  exp(-Xu)  exp(Xa)  =  S(u  -  a)  . 


(14) 


This  is  an  important  reference  case  and  will  be  used  frequently. 


The  SO  PDF  of  RV  z  at  arbitrary  field  point  z  =  [z^  Z2)  is 

Pz^^l'^2^  =  - 2  JJ  *^^l  *^^2  ®XP(-^1 211-^2^2  ^  ^z^^l'^2^ 
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Since  the  RVs  must  always  satisfy  Z2  <  (N-1)  the  field 

point  z  =  Z2]  should  be  chosen  so  that  field  components 

Z2  <  (N-1)  z^j  otherwise,  the  integral  result  in  equation  (15) 

will  yield  zero.  This  result  may  be  deduced  directly  from  the 

integral  for  SO  PDF  p^(z^,Z2)  in  equation  (15)  as  follows. 

Function  c(u,X)  in  equation  (3)  is  analytic  in  X  for  Re(X)  >  X  , 

c 

a  problem-dependent  critical  value.  Also,  c(u,X)  ~  exp(Xu)  as 
X  -♦  +®,  since  the  largest  that  x  can  be  in  equation  (3)  is  x  =  u. 
Therefore,  the  integrand  in  equation  (15)  is 

N— 1 

exp(-Xz2)  j^c(Zj^,X)j  ~  exp^-X^Z2  -  (N-1)  as  X  -»  +»  .  (16) 

If  contour  C  is  moved  far  to  the  right  in  the  X-plane,  where  the 
integrand  is  guaranteed  to  be  analytic,  then  the  integrand  tends 
to  zero  if  Z2  >  (N-1)  z^.  Therefore,  SO  PDF  p^(z^,Z2)  is  zero  in 
that  region  of  field  space.  The  joint  PDF  in  equation  (15)  can 
be  written  as 

Pz^^l'^2^  “  P(Z2)  [c(z^)]””^j  J  dX  exp(-Xz2) 

C 

(17) 


c(z^,X)'|N-l 
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where 


c(z^)  =  c(Zj^,0)  =  J  dx  p(x)  (18) 

—  00 


is  the  common  FO  CDF  of  RVs  n=l:N.  However,  the  leading 

factor  in  equation  (17)  is  just  the  FO  PDF  of  the  largest  RV 

•  Therefore,  the  remaining  term  must  be  the  conditional 
FO  PDF  of  RV  Z2  at  argument  22,  given  that  =  z^.  Expressing 


c(z^,X) 

C(  Zj^  ) 


p(x) 
c(  z^ ) 


exp( Xx ) 


00 

=  J  dx  p^(x) 

—  00 


exp(Xx)  , 


(19) 


the  quantity  Pj,(x)  is  recognized  as  the  conditional  PDF  of  each 
of  the  remaining  {x^}  RVs,  given  that  the  largest  one,  x£ ,  has 
taken  on  the  value  z^.  That  is. 


Pe(x) 


'p(x)/c(z^)  for  X  < 

,  0  for  X  >  z^. 


(20) 


The  corresponding  conditional  MGF  is  given  in  equation  (19). 

Since  all  the  remaining  {x^^}  RVs  are  still  independent  of  each 
other  (even  given  that  the  largest  RV  =  z^),  the  last  term  in 
the  integral  in  equation  (17)  is  the  FO  MGF  of  the  sum  Z2  the 
remaining  N-1  RVs,  given  that  RV  z^  equals  value  z^.  Finally, 
the  inverse  Laplace  transform  in  equation  (17)  yields  the 
conditional  FO  PDF  (at  argument  Z2)  of  RV  Z2,  which  is  the  sum  of 
the  remaining  RVs,  given  that  RV  z^  has  taken  on  the  value  z^. 
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Again,  M  *  2,  while  the  RVs  of  interest  are  now 


'  '2 


N 

■ 

n^l 


(21) 


where  the  tic  mark  on  the  sum  denotes  n  m.  The  SO  MGF  of  RV 
z  =  [z^  Z2]  is 

-  E  exp(Xjx;  +  Xj  x;) 

-  J...J  dUj---du^  g(Uj . u„)  exp(x^u_^  ^ 


u. 


=  Nl  J  dUj^  p(Uj^)  exp(X2Uj^)  J  du2  P(U2)  exp(X2U2) 


u 


m-2 


u 


m-1 


X  J  du„.i  p(u„.i)  exp(X2U^_j)  J  du^  p(u^l  exp(XjU^) 


u 


m 


u 


N-1 


X  J  P'W'  ®xp(X2U^^^)  •••  J  du„  p(u„)  expiX^u^)  .  (22) 


The  N-m  innermost  integrals  immediately  integrate  to 


1  ,  ,  .  . ,N-m 

(N-m)! 


(23) 


The  remaining  m  integrals  in  equation  (22)  require  that 

Ui  >  U2  >  •  •  •  >  Expressing  this  requirement  (see  appendix  B) 

as  u_  <  u^  1  <  •  •  •  <  U-)  <  Ui  enables  the  alternative  form  for  the 
m  m— 1  z  1 


9 


so  MGF  to  be  written  as 


-  Tn^  J  P'“m>  ®='P<Vm>  '  = 


N-m 


^  J  “’  J  exp(X2U^)  .  (24) 


u 


m 


u. 


The  m-1  innermost  integrals  are  simply 


1  f  /  \  \  1 IH”"  1 

(m-l)  !  ^ 


(25) 


The  SO  MGF  of  RV  z  then  follows  as 


=  m[JJ]  J  du  p(u)  exp(X3^u)  [c(u,X2)]^  [e(u,X2]"*  ^-(26) 

_0D 

For  m  =  1,  this  result  reduces  to  the  earlier  special  case  in 
equation  ( 13 ) . 


The  SO  PDF  of  RV  z  is  given  by  the  two-dimensional  inverse 
Laplace  transform  of  equation  (26),  namely, 

p  (z.,z_)  =  — - — =-  ff  dX>  dX_  exp(-  X^z^-  X_z-)  //  (  X^  ,  X- ) 

^  ^  ^  (i2n)^  C  1122Z12 

“  ”‘(m)  P<^l)  Hi  J  exp(-Xz2)  [  c  (  z^ ,  X)  ( e  (  z^  ,  X)  ,  (27) 

C 

where  equation  (14)  was  used.  For  m  =  1,  this  result  reduces  to 
that  in  equation  (15).  For  m  >  2,  there  is  no  limit  on  the 
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ranges  of  components  field  point  z  (except  where  PDF 

value  p(z^)  =  0).  That  is,  RV  Z2  in  equation  (21)  can  be 
arbitrarily  larger  than  RV  z^,  and  the  corresponding  PDF  value 
Pz^^l'^2^  can  be  nonzero.  In  terms  of  the  integral  in  equation 
(27)  for  p^(z^,Z2),  the  difference  for  m  >  2  is  that  e(z^,X)  is 
only  analytic  for  Re(X)  <  X^,  a  problem-dependent  critical  value. 
Any  attempt  to  move  contour  C  to  the  right  in  the  X-plane  will 
encounter  a  singularity  of  the  analytic  continuation  of  e(z^,X) 
at  Re(X)  =  Xg,  thereby  leading  to  a  nonzero  integral  result  for 
Pz^^l'^2^  at  any  2j^/Z2. 


The  SO  PDF  of  RV  z  can  be  written  as 

Pz(Zi,Z2)  =  m  p(z^)  [c(Zj^)]^“®  te(z^)]''"“^ 

1  P  rc(z^,X)'|^”"'  ('e(z.,X) 

^  I2i  J  exp(-Xz2)  c(z.,)  e(z.,) 

C  ^  1  J  K  1 

The  first  factor  (upper  line)  is  the  FO  PDF  of  the  m-th  largest 
RV  z-  =  x' .  That  is,  any  one  of  the  N  RVs  {x  }  could  take  on 
value  Zj^;  then,  there  are  (N-l|m-l)  possibilities  for  which  m-1 
RVs  lie  above  z^  and  the  remaining  N-m  RVs  lie  below  Zj^.  Thus, 
the  total  number  is  N  (N-l|m-l)  =  m  (N|m),  with  each  of  these 
possibilities  having  probability  [c(Zj^)]^“®"  ( e  (  z^^ )  . 


The  second  factor  in  equation  (28)  is  the  conditional  PDF  of 
RV  Z2  at  argument  Z2,  given  that  RV  =  z^.  It  is  also  the 
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inverse  Laplace  transform  of  the  conditional  FO  MGF  of  the  sum  Z2 
of  the  remaining  N-1  RVs,  given  that  ratio 


e( , X) 
e(  ) 


J  exp(Xx) 

^1 


00 

J  dx  Pg(x)  exp(Xx) 


(29) 


is  the  conditional  MGF  of  each  of  the  remaining  RVs  that  lie 
above  z^,  and 


Pe(x)  = 


|'p(  X  )/e  (  Zj^ )  for  X  >  z^' 
I  0  for  X  <  z-,. 


(30) 


is  the  corresponding  conditional  PDF,  given  that 
Since  all  of  the  m-1  remaining  RVs  that  lie  above  value  are 
independent  of  each  other,  and  all  of  the  N-m  remaining  RVs  that 
lie  below  value  are  independent  of  each  other,  the  conditional 
MGFs  can  be  multiplied  together  to  give  the  conditional  MGF  of 
the  remaining  sum  RV.  Finally,  the  inverse  Laplace  transform  in 
equation  (28)  gives  the  conditional  PDF  of  interest. 


12 


JOINT  PDF  OF  THE  TWO  LARGEST  RVS  AND  SUM  OF  REMAINING  RVS 


For  this  special  case,  M  =  3  and  the  RVs  of  interest  are 


Zi  =  X'  , 


N 

'2  “  *2  '  *3  =  H!  *n 

n=3 


(31) 


The  joint  third-order  (TO)  MGF  of  RV  z  =  [ z^  Z2  Z3]  is 


N  ^ 

Xjxi  +  Xjx-  +  X3 


n=3 


^z^^l'^2'^3^  =  E  exp 
-  J...J  du^-.-du^  g(u^ . Uj,)  exp  X^Uj  +  X^u^  +  Xj  C  u„ 


=  N!  J  du^  P(Uj^)  exp(X^u^)  du2  P(U2)  exp(X2U2) 


u. 


u 


N-1 


X  J  dUg  p(U2)  exp(X2U2)  J  exp(X2Uj^) 

—  <»  —CO 

CO  I 

N(N-l)  J  dn^  p(Uj^)  exp(Xj^u^)  J  du2  P(U2)  exp(X2U2)  c(u2,X3)^"^. 

—  CO 

(32) 


The  corresponding  TO  PDF  is  given  by  the  three-dimensional 
inverse  Laplace  transform 


;(Zi,Z2.Z3)  =  ^  .^^^3  JJJ  ^^2  ^^3  exip{-X^z^-\^z^-\^z^) 


(33) 


Substitution  of  /j  from  equation  (32)  into  equation  (33),  an 
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interchange  of  integrals,  and  use  of  equation  (14)  results  in 


c 

»  ^1 

X  J  dUj^  p(Uj^)  8(u^-2j^)  J  du2  P(u2)  ( c  ( U2 ,  )  ]^”^  S(U2-Z2)  •  (34) 

—  00  —00 

The  innermost  integral  on  U2  is  zero  if  Z2  >  .  Therefore,  its 

M  O 

value  is  p(z2^  I  c  (  Z2 ,  )  ]*^”  U(Uj^-Z2),  which  gives  the  TO  PDF 

Pz^^l'^2'^3^  =  N(N-l)  p(Zj^)  P(Z2)  U(Zj^-Z2) 

X  J  dX  exp(-Xz3)  [c(z2,X)]^~^  .  (35) 

C 

The  unit-step  function  U(  )  merely  emphasizes  that  field  point 
z  =  Izj^  Z2  Z3]  should  have  components  >  Z2  because  RVs  >  Z2 
always;  that  is,  x£  >  x^,  by  definition.  The  joint  PDF  must  be 
zero  if  field  point  components  z^  <  22* 

Initially,  there  is  no  obvious  limit  on  component  z^  of  field 
point  z;  however,  because  RVs  x^  <  x^  =  Z2  for  n=3:N,  then 

N 

C  x^  <  (N-2)  Z2  .  (36) 

n=3 

Therefore,  PDF  p^(z^,Z2,Z3)  will  be  nonzero  for  field  point 

components  z^  <  (N-2)  Z2;  any  choice  for  field  point  component  z^ 

larger  than  (N-2)  z-  will  result  in  a  zero  value  for  PDF  p  . 

z  z 
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This  same  result  may  be  deduced  from  the  integral  relation  for 

P.,  equation  (35);  the  analysis  is  identical  to  that  in  the 
discussion  surrounding  equation  (16).  In  summary,  field  point  z 
in  PDF  should  satisfy  z^^  >  Z2  >  to  realize  nonzero 

values  for  p_( z  ) . 


Equation  (35)  can  be  written  in  the  form 


Pz^^l'^2'^3^  =  N(N-l)  p(z^)  p(z,)  [c(z,)] 


N-2 


1' 

N-2 


1  r  rc(z-,X)') 

J  dX  exp(-Xz3)  . ) 


'2'  ) 


(37) 


The  leading  factor  (upper  line)  is  the  joint  SO  PDF  of  x£  = 
and  =  Z2  at  arguments  >  Z2.  The  last  factor  is  the 
conditional  PDF  of  RV  z^  at  argument  z^,  given  values  for  RVs  Zj^ 
and  Z2.  This  reasoning  is  identical  to  that  presented  earlier. 
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JOINT  PDF  OF  rij^-th  LARGEST  RV,  n2-th  LARGEST  RV, _ _ 

njj_j^-th  LARGEST  RV,  AND  SOM  OF  REMAINING  RVS 


Without  loss  of  generality,  1  <  <  n2  <  •••  <  <  N  and 

M  >  2.  The  first  step  is  to  identify  the  RVs 


*1 


N 

^'m-i  =  C  ' 

M-1  n^l 


(38) 


where  the  tic  mark  denotes  n  7^  n^,  n2,...,  Then,  the 

field  point  z  =  [z^^  Z2  •••  z^^]  is  taken  such  that 

>  ^2  ^  ^  ^M-1- 


These  events  can  only  occur  if  the  following  conditions  are 
met;  n^-1  RVs  must  lie  above  z^^;  n2-nj^-l  RVs  must  lie  between  Z2 
and  z^;  n2-n2-l  RVs  must  lie  between  z^  and  Z2;...; 

RVs  must  lie  between  and  ^“’^M-1  roust  lie  below 

The  number  of  ways  in  which  these  events  can  happen  is 


F  = 


where  M 


(n^-1)!  (n2-nj^-l)! 

>  2. 


N1 _ 

^”m-1“^M-2“^^ 


(39) 


If  an  "interval"  MGF  is  defined  as 


^b 


yw(UafUb/X)  =  J  dx  p(x)  exp(Xx)  =  cCu^fX) 

-  c(u^,X) 

u 

a 

=  e(u^,X) 

a 

®  f  ^ )  t 

(40) 

then  the  joint  PDF  of  RV  z  =  [  z^  •••  Zj^]  at  field  point  z  is 
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-  F  p(z^)  J  dx  exp(-XZjj) 


^  ^M— 1  1  o“”l 

^  f ^ ^ ^M-l ' ^  ^M-1 ' ^M-2 ' ^  ^  **’ 


n.-n^-l  n.-l 

^  (®(2j^,X)] 


(41) 


This  result  has  been  deduced  as  the  natural  extension  of  the 
earlier  multiple  integral  approaches  and  their  special  cases  in 
the  previous  section. 


An  alternative  form,  which  is  more  amenable  to  programming, 
is 


^  ik  J  '■'p'- 

C 


where  constant 

and 


(42) 


(43) 


I(X)  =  [e(z^,X)]  ^ 


%+l 


N-n 


X  [c(Zj^_j^,X)  ] 


M-1 


(44) 


For  each  X,  it  is  necessary  to  compute  {e(Zj^,X)}  for  m=l:M-l  and 

“  /^(X)  -  e(Zpj_j^,X). 
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Letting  X  =  X  +  iy,  where  X  is  (fairly  near)  the  real 
o  s 

saddlepoint  location  of  the  integrand  of  equation  (42),  then  the 
joint  PDF  in  equation  (42)  can  be  expressed  as 


N! 

Dll 


M-1 

TTip^z 

m=l 


m 


)} 


OD 

% 

dy  Re{exp[-(Xg+iy)Zj^]  KX^+iy)}  . 

0 


(45) 


COMMON  NONLINEAR  TRANSFORMATION  OF  REMAINING  RVs 

If  all  the  remaining  N+l-M  RVs  in  the  last  term  of  equation 
(38)  are  subjected  to  a  common  nonlinear  transformation,  h(x), 
prior  to  summation,  the  pertinent  e(u,X)  and  c(u,X)  functions 
above  must  be  replaced  by 

<o 

ej^(u,X)  *  J  dx  p(x)  exp[X  h(x)]  , 
u 

u 

=  J  dx  p(x)  exp[X  h(x)]  =  ej^(-®,X)  -  ej^(u,X)  .  (46) 

.00 

For  example,  if  =  |g^|,  where  =  N(0,1),  and  if  h(x)  =  x^, 
then  for  Re(X)  <  1/2, 


,(u,X)  =  J 


dx 


u 


(2n) 


^  -q  exp(-x^/2)  exp(Xx^) 


(1-2X) 


q  t  ^-u  (l-2X)'^j  for  u  >  0; 


(1-2X) 


for  u  <  0 


47) 


Also, 
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Cj^(u,  X) 


for  u  >  0;  0  for  u  <  0  .  (48) 


1  -  2$(-u  (1-2X)^) 
(1-2X)*^ 


These  are  not  the  same  functions  encountered  in  example  4  in 
appendix  A;  rather,  the  functions  here  can  be  expressed  as 


ej^(u,  X) 
In  general. 


ej^(u,  X) 


=  e^(u  ,X)  , 

letting  RV  y 
00 

-  J 

u 


Cj^(u,X)  =  c 
=  h( x) ,  there 

exp[ X  h(x ) ]  = 


(u^,X)  . 
follows  from 


J  dy  Py(y) 

h(u) 


(49) 

equation  (46) 

exp( Xy) 


s  ey(h(u) , X)  . 


(50) 


RATIOS  OF  RANDOM  VARIABLES 


The  ratios  of  RVs  are  defined  according  to 

’^m  “  *m^®M  m=l:M-l  .  (51) 


Then  the  joint  PDF  of 

[  •  r 

M-1  'mI 

=  (2  )”“^ 

•  •  • '^m'^m-1'^m’  ' 

(52) 

while  the  PDF  of  RV  r 

=  [  •  •  • 

'm-i> 

00 

Pr(’^l,*'*,rM-i)  = 

r  M-i 

*  *  * ''^‘^M-1'^^  • 

(53) 

It  is  necessary  to  carry  out  this  one— dimensional  integral  on  u 
to  evaluate  the  PDF  at  the  M-1  dimensional  field  point 
r  =  [r^^  •••  of  interest. 
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SUMMARY 


The  solutions  for  the  joint  PDFs  of  several  simpler  ordered 
statistics  problems  were  obtained  by  first  deriving  the  joint 
MGFs  of  the  RVs  of  interest.  Then,  the  multidimensional  inverse 
Laplace  transform  back  into  the  PDF  domain  was  manipulated  into  a 
form  that  involved  only  a  single  contour  integral  in  the  MGF 
domain.  Interpretation  of  the  final  form  in  terms  of  conditional 
MGFs  and  conditional  PDFs  afforded  useful  insights  on  the 
meanings  of  the  various  quantities  involved,  as  well  as  on  their 
interactions  with  each  other.  Finally,  these  results  were 
extended  to  the  general  problem  of  M-1  ordered  statistics  and  the 
sum  of  the  remaining  RVs  in  an  original  set  of  N  IID  RVs  with 
arbitrary  common  PDF  p(x). 

Numerical  evaluation  of  the  joint  PDF  is  most  easily 
accomplished  by  locating  (approximately)  the  real  saddlepoint  of 
the  MGF  integrand  in  the  X-plane,  and  using  a  Bromwich  contour 
that  passes  through  this  point.  It  is  not  necessary  to  resort  to 
a  saddlepoint  approximation  in  the  one  X  dimension;  instead,  very 
high  accuracy  in  the  numerical  evaluation  of  the  single  integral 
for  the  joint  PDF  can  be  achieved  with  little  computer  effort. 

An  alternative  approach  to  this  problem  is  afforded  by 
determining  the  joint  MGF  of  the  RV  z  and  then  resorting  to  a 
saddlepoint  approximation  to  obtain  the  joint  PDF  at  field  point 
z  of  interest.  This  technique  is  presented  in  appendix  C. 
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APPENDIX  A  —  EXAMPLES  OF  c{u,X)  AND  e(u,X) 

Equations  (3)  through  (6)  of  the  main  text  lead  to 

u 

c(u,X)  =  J  dx  p(x)  exp(Xx)  =  //(X)  -  e(u,X)  , 

~co 

+  00 

e(u,X)  =  J  dx  p(x)  exp(Xx)  =  /u(X)  -  c(u,X)  , 
u 

where  /u(X)  is  the  FO  MGF  corresponding  to  FO  PDF  p(x). 

EXAMPLE  1  -  EXPONENTIAL 

p(x)  =  exp(-x)  for  x  >  0,  0  for  x  <  0  ; 

c(u,X)  =  1  -  exp^-ud-Xn.  u  >  0,  0  for  u  <  0  ; 

e(u,X)  =  exp[-uU-X)J  u  >  0,  for  u  <  0  . 

In  the  relation  for  e(u,X),  Re(X)  <  1  is  also  required. 

EXAMPLE  2  -  GAUSSIAN,  x  =  g  =  N(0,1) 

p(x)  =  {2n)~^  exp(-x^/2)  for  all  x  ; 
c(u,X)  =  exp(X^/2)  §(u  -  X)  for  all  u,X  ; 
e(u,X)  =  exp(X^/2)  §(X  -  u)  for  all  u,X  . 

The  function  $  is  the  CDF  of  a  normalized  Gaussian  RV,  namely, 

X 

§(x)  =  J  dt  (2n)~*^  exp(-t^/2)  for  all  x  . 


A-1 


EXAMPLE  3  -  MAGNITUDE  GAUSSIAN,  X  =  |g| 

p(x)  =  exp(-x^/2)  for  x  >  0  ,  0  for  x  <  0  ; 

c(u,X)  =  2  exp(X^/2)  [§(X)  -  $(X  -  u)]  for  u  >  0,  0  for  u  <  0 
e(u,X)  =  2  exp(X^/2)  #(X  -  u)  for  u>0,  2  exp(X^/2)  $(X)  for  u<0 


EXAMPLE  4  -  SQUARED  GAUSSIAN,  X  =  g" 


p(x)  =  ---P' — ^  for  X  >  0,  0  for  x  <  0  ; 


c(u,X)  = 


( 2iix )  ^ 

1  -  2ii-  u^(l  -  2X)^) 


(1  -  2X) 


for  u  >  0,  0  for  u  <  0  ; 


e(u,X)  =  u  >  0,  (1  -  2X)  ^  for  u  <  0 

(1  -  2X)^ 


In  the  relation  for  e(u,X),  Re(X)  <  0.5  is  also  required. 


EXAMPLE  5  -  CHI-SQUARED  RV  OF  2k+2  DEGREES  OF  FREEDOM;  k=0,l,2, 


p(x)  =  - — ^  for  X  >  0,  0  for  x  <  0  ; 


c(u,X)  =  (1-X) 


-k-1 


[l  -  expf-u(l-X)]  C 

L  V  J  ].  J 


for  u  >  0 


=  0  for  u  <  0  ; 


e(u,X)  =  (1-X) 


-k-1 


expf-u(l-X)l  )  !  ^ for  u  >  0, 

^  ^  j=0 


=  (1-X)  ^  ^  for  u  <  0  . 


In  the  relation  for  e(u,X),  Re(X)  <  1  is  also  required, 


A- 2 


For  complex  arguments  of  #  in  examples  2  through  4,  the 
relation 

#(z)  =  j  exp(-z^/2)  w(-iz//2) 

in  terms  of  the  w  function  (reference  1,  chapter  7)  is  very 
useful . 

The  above  results  extend  immediately  to  a  scaled  and  shifted 
RV  X  =  a  +  b  X  according  to 

P(X.  .  i  p(^)  . 

c(u,X)  =  exp(aX)  c  ^,bxj  , 

e(u,X)  =  exp(aX)  e  ~  ^,bxj  . 
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APPENDIX  B  -  INTERCHANGE  OF  MULTIPLE  INTEGRALS 

Suppose  a  multiple  integral  over  the  range 
^a  ^  ^1  ^  ^2  ^  ^3  ^  ^  required,  namely, 

^b  "b 

^  =  J  '^'"l  J  '*''2  J  ‘^''3  J  ^''4  f(Ui,U2,U3,U4)  .  (B-1) 

^  ^1  ^2  ^3 


This  multiple  integral  may  be  expressed  in  numerous  equivalent 
representations,  such  as 


^b  ^4  ^3  ^2 

^a  ^a  ^a  ^a 

""b  "^3  ^2  ""b 

=  J  du3  J  du2  J  du^  J  du^  f(u^,U2,U3,U4) 

"a  ^a  ^a  ^3 

'^b  ^b  ^2  ^4 

-  J  dUj  J  du^  J  dUj  J  dUj  £(u^,U2,U3,u^) 

“a  "2  “a  “2 

"b  ^b  ^4  ^4 

=  J  dui  J  du^  J  du2  J  du3  f(u^,U2,U3,U4)  .  (B-2) 

^a  "l  ^1  ^^2 


Each  pair  of  limits  is  chosen  to  be  as  tight  as  possible.  The 
general  rule  is  that  if  a  potential  limit  variable  has  already 
been  integrated  out,  the  next  tightest  limit  variable  still 
active  should  be  selected. 
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APPENDIX  C  -  JOINT  MGF  OF  SELECTED  ORDERED  SET  AND  REMAINDER 


The  RVs  of  interest  are  those  listed  in  equation  (38)  and  its 
sequel,  except  that  the  original  RVs  are  specialized  here  to 

be  exponential  RVs  with  common  PDF  exp(-u)  for  u  >  0.  The  joint 
MGF  of  the  ordered  RVs  n=l;N,  is  shown  in  reference  2  (page 


68,  equation  (B-18))  to  be 


NI 


^o(“l,  •  *  •  ,“n)  “  (1-a^)  (2-aj^-a2)  •  •  •  (N-ttj^-  ••• 


(C-1) 


for  ^  ^  ^  ^1  ^2  ^  ^  f  f  ^1 


+  <  N.  Alternatively, 


use  of  the  Nxl  vector  a  =  [  •••  aj^]  produces 


N 

/io(a)  =  *  *  * '“n^  ' 


(C-2) 


where 


N 


and 


=  1  -  C  ^np  “p 


fl/n  for  p=l:n'|  . 
q  =  i  i  for  n=l;N 

lo  for  p=n+l:Nj 


(C-3) 


(C-4) 


Now,  the  NxN  matrix  Q  =  [q _ ]  is  defined.  Then,  Nxl  vector 

^np 


a)  = 


(  a) 


=  1  -  Q  a  , 


(C-5) 


where  1.  is  an  Nxl  vector  of  ones.  All  the  components  {'|>j^(a)} 
must  be  positive. 
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The  joint  MGF  /j{\)  of  the  RVs  of  interest  in  equation  (38)  is 
given  by  //^(  , .  . . ,  aj^) ,  with  every  replaced  by  (that  is, 

“n  except  for 

\  ^2  .  Vl  • 

with  Mxl  vector  X  =  ( X^  •••  X^J*^,  this  replacement  corresponds  to 
the  transformation  a  =  A  X,  where  NxM  matrix  A  has  ones  in  the 
M-th  column,  except  for  zeros  in  rows  n^ ,  n2 ,  .  . . ,  and  A  has 

ones  in  row  n^ ,  column  1;  row  n-,  column  2;...;  and  row  n  ,, 

X  z  M-1 

column  M-1.  The  result  is  joint  MGF  //(X)  =  l/n4>j^(a  =  A  X),  where 
•*>(«)  =  '(•(A  X)  =  1-  PX,  p  =  QA  =  [Pj^jj,]  .  (C-7) 

The  matrix  P  is  NxM. 


For  purposes  of  evaluating  the  saddlepoint  approximation  and 
a  correction  term  to  the  joint  PDF  corresponding  to  the  joint  MGF 
/j{X) ,  the  following  partial  derivatives  of  the  joint  CGF  are 
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needed.  Letting  <f>^  =  <()^(A  X)  and 
then 


3<l>n(A  X) 
3X 

m 


”  for  n=l:N,  m=l;M  , 


a  N 

^  X(X)  =  YZl  Krr.  ' 

fcl  """ 


N 


3X„  8X, 
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